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Docket No.: 21.1967 



IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 



In re the Application of: 



Toshikazu HORI, et al. 



Serial No. 09/661,428 



Group Art Unit: 2623 



Confirmation No. 841 0 



Filed: September 13, 2000 



Examiner: Brian Q. Le 



For: CHARACTER RECOGNITION DEVICE AND METHOD FOR DETECTING 

ERRONEOUSLY READ CHARACTERS, AND COMPUTER READABLE MEDIUM TO 
IMPLEMENT CHARACTER RECOGNITION 



Applicant filed a Notice of Appeal on August 5, 2004 in response to the Final Office 
Action of May 5, 2005 setting a response due date (Appeal Brief Due Date) of October 5. 2004. 
Applicant timely filed an Amendment After Final after Notice of Appeal on September 21 , 2004 
(copies included). 

However, the US Patent Office excessively delayed processing of the Amendment After 
Final after Notice of Appeal of September 21 , 2004 and did not forward this Amendment After 
Final to the Examiner until March 4, 2005 as evidenced by the Patent Application Information 
Retrieval (PAIR) (copy attached), so the Examiner did not have an opportunity to consider the 
After Final Amendment to issue an Advisory Action pursuant to MPEP 714.12-13 (i.e., any 
amendment timely filed after a final rejection should be immediately considered to determine 
whether it places the application in condition for allowance or in better form for appeal). See 
also, MPEP 1207 - Amendment Filed with or After Appeal. In particular, the Applicant contacted 
the Examiner on March 4, 2005 (Interview Summary attached) and the Examiner issued an 
Advisory Action before filing of an Appeal Brief on March 7, 2005 (copy attached). 



REQUEST FOR REFUND 



MAIL STOP 16 

Commissioner for Patents 
PO Box 1450 

Alexandria, VA 22313-1450 



Sir: 



Serial No. 09/661,428 



Therefore, because the USPTO did not process and forward to the Examiner the 
Amendment After Final until March 4, 2005, it was necessary by the Applicant to file a Request 
for Continued Examination (RCE), along with a five-month extension of time fee in the amount of 
$2,160.00, on March 7, 2005, to continue examination of the present application and avoid 
abandonment of the patent application. 

Accordingly, the Applicants respectfully request a refund of the second through five 
month extension of time fees in the amount of $2,040.00, which is fifth month extension of time 
fee of $2,160.00 (37 CFR 1 .17(a)(5)) less one month extension of time fee of $120.00 (37 CFR 
1.17(a)(1), as being "in excess of that required' (37 CFR 1.26), if the Patent Office had not 
delayed and timely forwarded to the Examiner the After Final Response of September 21 , 2004 
at least within the first extended due date of November 5, 2004 from the filing of the Notice of 
Appeal on August 5, 2005. 

Therefore, at least the second, third, fourth and fifth month extension of time fees in the 
amount of $2,040.00 should be refunded. 

Accordingly, it is respectfully requested any refund in connection with this request be 
credited to our Deposit Account No. 19-3935 and that the Patent Office acknowledge this credit 
in writing to the undersigned. 



Respectfully submitted, 
STAAS & HALSEY LLP 



Date: 




By: 




Mehdi D. Sheikerz 
Registration No. 41,307 



1201 New York Ave, N.W., Suite 700 
Washington, D.C. 20005 
Telephone: (202)434-1500 
Facsimile: (202) 434-1 501 



2 



'M A1 



oil 



Attorney Docket No. 21 . 1 967 
UNITED STATES PATENT AND TRADEMARK OFFICE 



In re Patent Application of: 
Toshikazu HORI, et al. 
Application No.: 09/661 ,428 
Filed: September 1 3, 2000 




Unit: 2623 
Examiner Brian Q. Le 



For: CHARACTER RECOGNITION DEVICE AND METHOD FOR DETECTING 

ERRONEOUSLY READ CHARACTERS, AND COMPUTER READABLE MEDIUM TO 
IMPLEMENT CHARACTER RECOGNITION 

NOTICE OF APPEAL FROM THE PRIMARY EXAMINER 
TO THE BOARD OF PATENT APPEALS AND INTERFERENCES 

Commissioner for Patents 
PO Box 1450 

Alexandria, VA 22313-1450 
Attention: After Final 

Sir: 

Applicant hereby appeals to the Board from the decision of the Primary Examiner mailed 
May 5, 2004 finally rejecting claims 1-16. The items checked below are appropriate: 



1. EXTENSION OF TIME PETITION AND FEE 



Attached is a petition for a -month extension of time 

for reply to the final rejection. $ 

2. APPEAL FEE 

X Other than a small entity 330.00 



TOTAL FEE 



$ 330.00 



Application No.: 09/661,428 

3. PAYMENT 

X Check attached for the total fee of $ 330.00 . 
_X_ Charge Account 1 9-3935 for any fee deficiency. 

Respectfully submitted, 
STAAS & HALSEY LLP 

Dated: C KaH 

1201 New York Ave, N.W., Suite 700 
Washington, D.C. 20005 
Telephone: (202)434-1500 
Facsimile: (202)434-1501 



By: 




James T. Strom 
Registration No. 48,702 



©2001 Staas & Halsey LLP 



Please Date Stamp and return 
Not\,3 of Appeal; Check $330.00 




APPLICANT(S): Toshikazu HORI, et al. 
SERIAL NO: 09/661,428 
CONFIRMATION NO. 8410 



TITLE: 

FILING DATE: 
DOCKET NO: 
DUE DATE: 
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ING 



CHARACTER RECOGNITION DEVICE AND METHOD FOR DETECTING 
ERRONEOUSLY READ CHARACTERS. AND COMPUTER READABLE 
MEDIUM TO IMPLEMENT CHARACTER RECOGNITION 

September 13, 2000 

21.1967/JTS:na 

August 5, 2004 





FEE CALCULATION (fees effective 10/01/03) 



CLAIMS AS 
AMENDED 



Claims Remaining 
After Amendment 



Highest Number 
Previously Paid For 



Number 
Extra 



Rate 



Calculations 



TOTAL CLAIMS 



20 



20 = 



X$ 18.00 = 



$ 0.00 



INDEPENDENT 
CLAIMS 



4 = 



X $ 86.00 



86.00 



Since an Official Action set an original due date of August 5. 2004 . A Notice of Appeal was filed 
August 5, 2004 thereby extending the response due date to October 5, 2004. No extension of time 
fees are required. 



if Notice of Appeal is enclosed, add ($330.00) 



If Statutory Disclaimer under Rule 20(d) is enclosed, add fee ($11 0.00) 



Information Disclosure Statement (Rule 1.1 7(p)) ($180.00) 



Total of above Calculations = 



Reduction by 50% for filing by small entity (37 CFR 1 .9, 1 .27 & 1 28) 



$ 86.00 



TOTAL FEES DUE 



(1) If entry (1 ) is Jess than entry (2% entry (3) is "0". 

(2) tf entry (2) is less than 20. change entry (2) to "20". 

(4) tf entry (4) is less than entry (5). entry (6) is "0*. 

(5) If entry (5) is less than 3, change entry (5) to "3". 



$ 86.00 



METHOD OF PAYMENT 



S Check enclosed as payment. 

□ Charge 'TOTAL FEES DUE" to the Deposit Account No. below. 

□ No payment is enclosed and no charges to the Deposit Account are authorized at this time (unless specifically 
required to obtain a filing date). F y 



GENERAL AUTHORIZATION 



If the above-noted "AMOUNT ENCLOSED" is not correct, the Commissioner is hereby authorized to credit 
any overpayment or charge any additional fees necessary to : 



Deposit Account No. 
Deposit Account Name 



19-3935 



STAAS & HALSEY LLP 



S^STl'f S /^ ner i S aIS0 authori2ed 10 credit an y overpayments or charge any additional fees required under 
37 CFR 1 16 (filing fees) or 37 CFR 1.17 (processing fees) during the prosecution of this application, including 
any related application(s) claiming benefit hereof pursuant to 35 USC § 120 (e g 

ran^uations/dMstonals/CIPs under 37 CFR 1 .53(b) and/or continuations/divisionals/CPAs under 37 CFR 
1 .53(d)) to maintain pendency hereof or of any such related application. 



SUBMITTED BY: STAAS & HALSEY LLP 



Typed Name James T. Strom 



Reg. No. 48,702 



Signature 




Otter- 



Date 
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RESPONSE UNDER 37 CFR 1.116 
EXPEDITED PROCEDURE 

^ "A EXAMINING GROUP 2623 

'MM v7 , J Docket No.: 21.1967 

%> .-J? ,N THE UN,TED STATES PATENT AND TRADEMARK OFFICE 

In re the Application of: 

Toshikazu HORI.etal. 

Serial No. 09/661,428 Group Art Unit: 2623 

Confirmation No. 8410 

Filed: September 13, 2000 Examiner: Brian Q. Le 

For: CHARACTER RECOGNITION DEVICE AND METHOD FOR DETECTING 

ERRONEOUSLY READ CHARACTERS, AND COMPUTER READABLE MEDIUM TO 
IMPLEMENT CHARACTER RECOGNITION 

AMENDMENT AFTER FINAL REJECTION 

Commissioner for Patents 
PO Box 1450 

Alexandria, VA 22313-1450 

Attention: BOX AF 

Sir: 

This is in response to the Office Action mailed May 5. 2004, and having a period for 
response set. to expire on August 5, 2004. A Notice of Appeal was filed August 5, 2004 thereby 
extending the response due date to October 5, 2004. 

Reconsideration of the claims is respectfully requested. The following remarks are 
respectfully submitted. 
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IN THE CLAIMS: 

The text of all pending claims are set forth below. Cancelled and withdrawn claims are 
indicated with claim number and status only. The claims as listed below show added text with 
underlining and deleted text with strikothrough . The status of each claim is indicated with one of 
(original), (currently amended), (previously presented), (cancelled), (withdrawn), (new), 
(previously added), (reinstated - formerly claim #), (previously reinstated), (re-presented - 
formerly dependent claim #) or, (previously re-presented). 

Please AMEND the claims in accordance with the following: 

1 . (CURRENTLY AMENDED) A character recognition device to recognize 
characters in a captured text image road by an imago ocanncr , comprising: 

a multiple recognition pfogfaftHJjTjtto separately p erform character recognition of the text 
image using respoctivo at least two differe n t character recognition-methed s algorithms, each 
algorithm producing its own recognize d characters from the same text image, whare th* 
recognized characters of the respective a lgorithms are non-coinciding for some corresponding 
same locations of the text image and coi n cide for other corresponding same locations of the text 
image : 

an extraction program to uniLextracting thejocations corresponding to tha t innn. 
coinciding rocults in tho characters recognized by the respective recognition algorithms 
mothodo ; and 

an 0Ut P ut Program to dooignato unit designating the jpcatipnsoLnon-coinciding locationo 
resultsextracted by the extractlon-pfeafam-jjniLand te-eutetrt outputtino character recognition 
results for the text image. 

2. (CURRENTLY AMENDED) A character recognition device to recognize 
characters in a captured text imag e ro n d by an imago coannor , comprising: 

a first recognition pfeafam-ynitto recognize the characters in the text image using a first 
character recognition m e thod algorithm: 

a second recognition pregfam^njtto recognize the characters in the text image using a 
second character recognitionH*ethe4-_aJg£ri^^ from the first character recognition 
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method algorithm, where each ch aracter recognition algorithm produces its own recognized 
characters from the same text ima ge and where the recognized characters of the respective 
algorithms are non-coincidino for s ome corresponding same locations of the text imaoe and 
coincide for other corresponding same locations of the text image - 

an extraction program to unjLextractingJhe locations of recognized characters in the text 
image wherein the recognition results of the first recognition-program- unit do not coincide with 
the recognition results of the second recognition program; and 

an outpu t program to output unit outouttino character recognition results designating the 
non-coinciding locations extracted by the extraction program. 

3. (CURRENTLY AMENDED) A character recognition device as recited in claim 1 , 
wherein the output-pr^gfam-jjnjLcontrasts the text image and the character recognition results. 

4. (CURRENTLY AMENDED) A character recognition device as recited in claim 2, . 
wherein the output-^sfa^jmlcontrasts the text image and the character recognition results. 

5. (CURRENTLY AMENDED) A character recognition device as recited in claim 1 , 
further comprising: 

a display having a display screen to display character recognition results, 
wherein the outputunjt.- program to contrasts the text image and the character 
recognition results while displaying the character recognition results on the display screen, and 
displays a cursor in a display area of the character recognition results while displaying the text 
image in a format that designates the location of the text image coordinated at the position of the 
cursor. 

6. (CURRENTLY AMENDED) A character recognition device as recited in claim 2, 
further comprising: 

a display having a display screen to display character recognition results, 
wherein the output-pfegfaw-jjnjLcontrasts the text image and the character recognition 
results while displaying the character recognition results on the display screen, and displays a 
cursor in a display area of the character recognition results while displaying the text image in a 
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format that designates the location of the text image coordinated at the position of the cursor. 

7. (CURRENTLY AMENDED) A character recognition device as recited in claim 1 , 
further comprising: 

an outpu t program to output unit outouttina a symbol or a blank to display locations that 
do not coincide instead of the recognized characters. 

8. (CURRENTLY AMENDED) A character recognition device as recited in claim 2, 
further comprising: 

an outpu t program to output unit outputtina a symbol or a blank to display locations that 
do not coincide instead of the recognized characters. 

9. (CURRENTLY AMENDED) A character recognition device as recited in claim 1 , 
further comprising: 

an outpu t program to output unit outputtina th» recognized characters with a high 
evaluation value for the non-coinciding locations that have the same number of recognized 
characters in an output format that is different from the output format of the non-coinciding 
locations. 



10. (CURRENTLY AMENDED) A character recognition device as recited in claim 2, 
further comprising: 

an outpu t program to output unit outputtina t h« recognized characters with a high 
evaluation value for the non-coinciding locations that have the same number of recognized 
characters in an output format that is different from the output format of the non-coinciding 
locations. 



1 1 . (CURRENTLY AMENDED) A character recognition device as recited in claim 1 . 
further comprising: 

an outpu t program to output unit outouttina th« recognized characters of the non- 
coinciding locations selected using a prescribed standard for the non-coincident locations with a 
different number of recognized characters in a format that is different from the output format for 
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the non-coinciding locations. 

12. (CURRENTLY AMENDED) A character recognition device as recited in claim 2, 
further comprising: 

an outpu t program to output unit outputtino the recognized characters of the non- 
coinciding locations selected using a prescribed standard for the non-coincident locations with a 
different number of recognized characters in a format that is different from the output format for 
the non-coinciding locations. 

13. (CURRENTLY AMENDED) A character recognition device as recited in claim 1, 
further comprising: 

an outpu t program to output unit outputtinq in a format indicating that the recognition 
results coincide but have a low recognition reliability. 

14. (CURRENTLY AMENDED) A character recognition device as recited in claim 2, 
further comprising: 

an outpu t program to output unit outputtinq in a format indicating that the recognition 
results coincide but have a low recognition reliability. 

15. (CURRENTLY AMENDED) A character recognition method to recognize 
characters in a captured text image- rp nr t h y an Imago ccan nui, comprising: 

recognizing characters in the text image using a prescribed character recognition^flethed 
algorithm : 

recognizing characters in the text image using a character recognition-method - algorithm 
drfferent from the prescribed character recognitionHBethed algorithm. where nrH ,h ara .w 
recognition algorithm produces its own recooni^H char a cters from th» carT ie teyt ima n. ar ,H 
where the recognized characters of the respective a innrith ms are nn n-.ninHH.n q w , m 
corresponding same locations of thR text imaoe anH ™in C ide for othflr ^^ S DOndinf1 , amo 
locations of the text image: 

extractin 9 the locations corresponding to the non-coinciding lontinnc botwoon thu 
recognition results of the character recognition using the prescribed^haracter recognition 
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method - algorithm and the recognition results of the character recognition-method - algorithm 
different from the prescribe d character recognition-metho d algorithm: and 

designating the locations of non-coinciding l ocationc extracted results and outputting the 
recognition results of the characters in the text image. 

16. (CURRENTLY AMENDED) A computer readable medium encoded with 
processing instructions for implementing a character recognition method of recognizing 
characters in a capjured_text imag e r n n r l b y an imago ooonnu , the character recognition-method 
algorithm comprising- 

recognizing characters in the text image using a prescribed character recognition-method 
algorithm: 

recognizing characters in the text image using a prescribed character recognition-method 
iilgjD^hm. different from the prescribed chgigc^recognition-mefto d algorithm, where e^h 
character recognition algorithm produces its nw n recoonireri characters from the samp te vt 
image and where the recognised characters nf the re s pective alnnrithrn. are non-^inriHinn m r 
some corresponding same locations of the text iman» a nd coincide fnr nth e r corresnnnHi^ 
same locations of the text image: 

extracting the locations corresponriinn tn th* non-coinciding hnntione between tliu 
recognition results of the character recognition using the prescribed character recognition 
method - algorithm and the recognition results of the character recognition-method - algorithm 
different from the prescribed character recognition-metho d algorithm : and 

designating thejocajionsof non-coinciding lo cations extracted results a nd outputting the 
recognition results of the characters in the text image. 

1 7. (NEW) A method for recognizing characters in a captured text image, the method 
comprising: 

providing a first character recognition algorithm and a second character recognition 
algorithm, where each character recognition outputs its own recognized characters, and where 
the character recognition algorithms are capable of recognizing same character-images as 
different recognized characters; 

outputting recognized characters by performing character recognition on the captured 
text image with each character recognition algorithm; and 
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identifying areas of the text of the captured image based on discrepancies between 
respective outputs of the character recognition algorithms that correspond to the areas. 

18. (NEW) A method according to claim 17, further comprising: when a user is editing 
text of the text image location, directing the editing to the identified areas. 

19. (NEW) A method according to claim 17, further comprising: when displaying 
recognized text of the text image, distinguishably displaying the identified areas. 

20. (NEW) A method according to claim 19. further comprising: when displaying 
recognized text of the text image, displaying characters in the identified areas based on which 
recognition algorithm had a highest recognition evaluation for the respective characters. 
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REMARKS 

INTRODUCTION 

Claims 1-16 were previously pending and under consideration. 
Claims 17-20 are added herein. 

Therefore, claims 1-20 are now pending and under consideration. 
Claims 1 -1 6 are rejected. 
Claims 1-16 are amended herein. 

No new matter is being presented, and approval and entry are respectfully requested. 



ENTRY OF AMENDMENT UNDER 37 CFR §1.116 

Applicant requests entry of this Rule 116 Response because: 

(a) it is believed that the amendment of the claims puts this application into condition for 
allowance as suggested by the Examiner 

(b) the amendments were not earlier presented because the Applicant believed in good 
faith that the cited prior art did not disclose the present invention as previously claimed; 

(c) the amendments of the claims should not entail any further search by the Examiner 
since no new features are being added or no new issues are being raised; and 

(d) the amendments do not significantly alter the scope of the claims and place the 
application at least into a better form for purposes of appeal. No new features or new issues are 
being raised. 

The Manual of Patent Examining Procedures sets forth in Section 714.12 that "any 
amendment that would place the case either in condition for allowance or in better form far 
aepeaj may be entered." Moreover, Section 714.13 sets forth that "the Proposed Amendment 
should be given sufficient consideration to determine whether the claims are in condition for 
allowance and/or whether the issues on appeal are simplified." The Manual of Patent Examining 
Procedures further articulates that the reason for any non-entry should be explained expressly in 
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the Advisory Action. 



REJECTIONS UNDER 35 USC § 103 

In the Office Action, at pages 3-6, claims 1-16 were rejected under 35 U.S.C. § 103 as 
being unpatentable over Hotta in view of Shirasaki. This rejection is traversed and 
reconsideration is requested. 

Hotta is cited as teaching plural recognition methods. The rejection indicated that "non- 
coinciding characters" is being interpreted as equivalent to "misrecognized characters" (page 2 
lines 1 8-20 of the Office Action). 

The amended claims recite a feature of two character recognition algorithms being used 
to find non-coinciding characters. This feature is not disclosed or suggested in the prior art. 

The rejection compared the feature of performing character recognition using respective 
recognition methods to Figure 4, boxes 9-1 1 , and 1 5 of Hotta. However, Hota discusses 
methods (or sub-methods) that are part of a single character recognition process. In other 
words, the "character segmentation unit" (box 9), the "feature vector computing unit" (box 1 0) 
the "character category determining unit" (box 1 1 ), etc. of Hotta are all parts of one character ' 
recognition algorithm. They are not different character recognition algorithms. 

To clarify that the character recognition methods of the present claims are not parts of 
one recognition method, the claims are amended to recite "recognition algorithms" (see page 15 
line 15 of the specification) that each produce their own recognized characters from the same 
text image. The boxes in Figure 4 of Hotta are clearly not recognition algorithms that each 
produce their own recognized characters; there is only one recognition result that comes from 
their cooperation. 

Applicant respectfully traverses the rejection's assertion that non-coinciding characters 
are the same as misrecognized characters. The Merriam Webster Online Dictionary-indicates 
that to "coincide" is "to be in accord or agreement : CONCUR". A misrecognized character in 
the cited references does not agree or concur with the imace text . However, the non- 
coincidence in the present claims is non-coincidence between two different recognized 
characters of a same portion/location of the text image. In other words, there is non-coincidence 
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between the output of the two or more character recognition algorithms. 

Other amendments herein are intended to broaden the claims. The phrase "a text image 
read by an image scanner has been broadened to a "captured text image". The feature of a 
"program" has been broadened to a "unit". 



DEPENDENT CLAIMS 

The dependent claims are deemed patentable due at least to their dependence from 
allowable independent claims. These claims are also patentable due to their recitation of 
independently distinguishing features. For example, claim 3 recites outputting the recognition 
results by contrasting the text image and the recognition results. This feature is not taught or 
suggested by the prior art. Withdrawal of the rejection of the dependent claims is respectfully 
requested. 



CONCLUSION 

There being no further outstanding objections or rejections, it is submitted that the 
application is in condition for allowance. An early action to that effect is courteously solicited. 

Finally, if there are any formal matters remaining after this response, the Examiner is 
requested to telephone the undersigned to attend to these matters. 
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If there are any additional fees associated with filing of this Amendment, please charge 
the same to our Deposit Account No. 19-3935. 



Date: 1* ( $<q< l&t^T 



1201 New York Ave, N.W., Suite 700 
Washington, D.C. 20005 
Telephone: (202)434-1500 
Facsimile: (202)434-1501 



Respectfully submitted, 
STAAS & HALSEY LLP 





By:. 

Jamds T. Strom 
Registration No. 48,702 
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